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Executive Summary 



Home schooling in the United States has be- 
come a topic of interest to education policymak- 
ers, administrators, and the general public. 
Currently, published estimates of the number of 
children who are home schooled vary by hundreds 
of thousands of children and are of uncertain reli- 
ability. Informed discussions of home-schooling 
policy are compromised without accurate esti- 
mates of how many children are educated at home 
and whether the proportion of children who are so 
educated is changing. 

Estimates of the number and proportion of stu- 
dents who were home schooled derived from two 
sets of national survey data from the mid-1990s — 
the October 1994 Current Population Survey Edu- 
cation Supplement (CPS:Oct94); and the 1996 
National Household Education Survey, Parent and 
Family Involvement/Civic Involvement compo- 
nent (NHES:96, PFI/CI) — also vary. The point 
estimates of the number of children ages 6 to 17 
who were home schooled ranged from 345,000 in 
CPS:Oct94 to 636,000 in NHES:96 (figure A). 
Taking estimated sampling variance into account, 
the 95-percent confidence interval around the 
CPS:Oct94 point estimate ranges from 287,000 to 
402,000, and the 95-percent confidence interval 
from 515,000 to 757,000 around the NHES:96 
point estimate. According to CPS:Oct94, 0.8 per- 
cent of children were home schooled, and ac- 
cording to NHES:96, 1.4 percent of children were 
home schooled. 

Although the differences between these sur- 
veys’ estimates may reflect growth in the number 
and proportion of students who are home 



schooled, it seems unlikely that the number of 
home-schooled children nearly doubled in less 
than two years (Lines 1998; Ray 1999). This re- 
port explores differences in survey design and 
execution that may have contributed to these two 
different estimates. 

Figure A — CPS:Oct94 and NHES:96 point estimates 
and their 95-percent confidence intervals 
of number of home-schooled 6- to 
17-year-olds 



Number of home- 
schooled 6- to 17- 
year-olds 




SOURCE: U.S. Department of Commerce, Bureau of the 
Census, Current Population Survey, October 1 994 
(CPS:Oct94); U.S. Department of Education, National 
Center for Education Statistics, National Household Education 
Survey of 1996, Parent and Family Involvement/Civic 
Involvement Component (NHES:96, PFI/CI). 
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Executive Summary 



The report is based on the premise that for any 
given year, there is some “true” number of home- 
schooled children in the population. Point esti- 
mates derived from the CPS and NHES depart 
from this true value by some amount of error. Er- 
rors in surveys include errors in nonobservation, 
errors in observation, and data processing errors 
(Groves 1991). After describing the data sources, 
this report examines each type of error. 

Data Sources 

For decades the Census Bureau has conducted 
the Current Population Survey (CPS) each month 
on behalf of the Bureau of Labor Statistics in or- 
der to study labor force participation and unem- 
ployment. The CPS includes a set of basic labor 
force and demographic questions that are repeated 
each month and a supplement, whose topic varies 
from month to month. Each October’ s supplement 
focuses on participation in education programs for 
civilians age 3 and older, and in 1994 the October 
supplement included questions related to home 
schooling. 

CPS samples households using addresses from 
the most recent Decennial Census and updates to 
it as the sampling frame. Each sampled household 
is part of CPS for 8 months. In its first- and fifth- 
month interviews, the household’s interview is 
conducted in person: a Census Bureau interviewer 
visits the home and conducts the interview with a 
laptop computer. With the household’s permis- 
sion, the remaining six interviews are conducted 
by telephone. Interviewers attempt to speak with 
the most knowledgeable person in the household, 
although any household member 15 years old or 
older may serve as the respondent. Respondents 
answer questions regarding all household mem- 
bers. 



The National Center for Education Statistics 
(NCES) has conducted the National Household 
Education Survey (NHES) five times since the 
first administration in 1991. NCES uses NHES to 
collect data on education issues on which house- 
holds, rather than education institutions, are best 
able to provide data. Each time the NHES is 
fielded, a Screener interview is used to determine 
whether the household includes members who are 
eligible for either of two extended topical inter- 
views. In 1996, one of these interviews — the Par- 
ent and Family Involvement/Civic Involvement 
(PFI/CI) component — of the NHES included 
questions on children’s schooling, including home 
schooling. The PFI/CI component sampled chil- 
dren from age 3 through 12th grade, with a maxi- 
mum age of 20. 

NHES is a random-digit-dial (RDD) telephone 
survey, i.e., it samples households via telephone 
numbers. Interviewers in telephone centers use 
computer-assisted telephone interviewing (CATI) 
to conduct interviews from January through April 
of the administration year. Interviewers ask to 
speak with a household member at least 18 years 
old, who responds to the Screener questions. In 
1996, once the interviewer determined through the 
Screener that a child in the household was eligible 
for the PFI/CI, the interviewer asked to speak with 
the parent or guardian who knew the most about 
the sampled child’s care and education. 

Impact of Nonobservational Errors 

Errors of nonobservation occur when members 
of the target population are excluded from the 
sampling frame or when sampled members of the 
population fail to participate in the survey or some 
part thereof. This report discusses both of these 
sources of nonobservation error: sample coverage 
and nonresponse. 
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Sample Coverage 

Both the CPS and NHES sampling frames un- 
dercover some groups within the U.S. noninstitu- 
tionalized population, although each undercovers 
different segments. The Census Bureau estimates 
that CPS undercovers between 7 and 1 3 percent of 
infants through 19-year-olds in the population. 
Among children, males, blacks, and older children 
are more likely than females, nonblacks, and 
younger children to be missed. Sampling weights 
adjust for undercoverage with respect to these 
demographic characteristics, but to the extent that 
undercovered groups home school at rates differ- 
ent from the general population, these weights 
may not eliminate error in estimates related to 
home schooling. However, because home school- 
ing is a rare event and the rates of undercoverage 
are low, even if the relatively small undercovered 
groups were home schooled at rates considerably 
higher or lower than the general population, the 
error in the estimates would be small. 

NHES has two primary sources of undercover- 
age: the exclusion of nontelephone households 
and the exclusion of some residential telephone 
numbers due to the particular method of random 
digit dialing used to sample households. 
CPS:Oct94 data indicate that approximately 6 per- 
cent of households did not have telephones. Sam- 
pling weights adjust NHES estimates to 
population controls derived from the Census, and 
therefore adjust for the undercoverage of house- 
holds without telephones. CPS:Oct94 data indi- 
cate that children in nontelephone households 
were home schooled at the same rate as children 
in telephone households, and therefore there is no 
evidence of error due to the exclusion of nontele- 
phone households. 

To reduce costs, the NHES uses the list- 
assisted method of random digit dialing, and 
studies of the list-assisted method indicate that 3 



to 4 percent of residential telephone numbers are 
excluded from the sampling frame when this 
method is used. It is not possible to determine em- 
pirically whether children in these households are 
more or less likely to be home schooled than are 
children in included households. However, the 
rate of home schooling is generally low and the 
proportion of excluded households is small. 
Therefore, even if the rate of home schooling were 
considerably different among excluded house- 
holds compared with included households, the 
potential error in the estimated number and per- 
centage of home-schooled children would be 
small. 

Although there is some potential for error in 
the studies’ sampling frames, neither of the stud- 
ies’ sample designs appears to be biased. Both 
studies sample randomly from households within 
their frames and oversample some minority groups 
to collect sufficient data for reliable estimates 
concerning those groups. NHES:96 PFI/CI ran- 
domly sampled children within households, de- 
pending on the number of children who were 
eligible to participate within a household. 

Response Rates 

Response rates were calculated at three lev- 
els — household, supplement or extended inter- 
view, and item — for each survey. The CPS:Oct94 
household response rate (94 percent) is considera- 
bly higher than the NHES:96 Screener response 
rate (70 percent). The low household response rate 
in the NHES allows for the possibility that home- 
schooling families, who may not wish to be identi- 
fied or involved in government-related research 
(Kaseman and Kaseman 1991), may have partici- 
pated at a lower rate than other families. However, 
because families with children in grades K-12 
make up approximately 30 percent of the popula- 
tion of households in the United States, approxi- 
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mately 9 percent, rather than the entire 30 percent, 
of nonresponding households might include chil- 
dren in the desired age/grade range who were 
home schooled. At the second level, supplement in 
CPS and PFI/CI interview in NHES, the CPS 
again had a higher response rate than the NHES 
(97 percent compared with 89 percent, respec- 
tively). 

In both surveys the item response rates were 
high for items used in these analyses. Among the 
items that identify home-schooled children in 
CPS:Oct94, all of the items had response rates of 
at least 92 percent, and nearly all relevant items in 
NHES: 96 had item completion rates approaching 
100 percent. It appears, therefore, that families 
who participated in the surveys were not unwilling 
to discuss home schooling. 

However, because missing data for many items 
were not imputed in the CPS:Oct94 data set, some 
cases had to be excluded from the CPS analyses 
because it was not possible to determine whether 
they met the criteria that defined the sample or 
whether they were home schooled. The excluded 
cases represented about 2 million of the 46 million 
6- to 17-year-olds in the United States. If the ex- 
cluded children were home schooled at the same 
rate as children who were included, approximately 
30,000 additional children would be home 
schooled. However, the characteristics of ex- 
cluded children, especially age, suggest that ex- 
cluded children may well be home schooled at a 
lower rate than included children. 

Thus, although missing data may bias the 
CPS:Oct94 estimate, they are not likely to affect it 
greatly. The effect of the lower NHES: 96 house- 
hold response rate cannot be estimated. 



Impact of Observational Errors 

Observational errors can be introduced by data 
collection procedures, survey instruments, and 
respondents. 

Data Collection 

The surveys differ with respect to data collec- 
tion procedures in at least three ways. First, al- 
though both surveys are conducted with computer- 
assisted interviewing (CAI), CPS interviewers use 
both personal interviewing (CAPI) and telephone 
interviewing (CATI), whereas NHES interviews 
are conducted entirely via telephone interviewing. 
Whether and how personal interviewing, com- 
pared with telephone interviewing, might produce 
different results with respect to home schooling is 
unknown. 

Second, CPS is a panel survey, whereas NHES 
is not. The effects of this, aside from potential 
differences in response rates (which were exam- 
ined separately), cannot be assessed with available 
data. 

Third, the surveys also differ with respect to 
timing. In addition to the 15- to 18-month span 
between surveys’ administration, the two surveys 
differ in the time of year at which they were ad- 
ministered. The NHES is administered from Janu- 
ary through April, in contrast to the October 
administration of the CPS:Oct94. To the degree 
that parents are more likely to home school their 
children at some times of the year than at others, 
the difference in survey timing may contribute to 
the difference between the estimates. 

Instrument Error 

This report examined question wording, ques- 
tion sequencing, and the location of home- 
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schooling items as potential sources of instrument 
error. 

Question Wording and Sequencing 

The questions regarding home schooling were 
worded differently between the two studies and 
even among interviews in CPS:Oct94. CPS:Oct94 
interviews varied depending on the age and en- 
rollment status of the person about whom the in- 
terview was being conducted. Regarding enrolled 
children, the question as to whether the child was 
“schooled primarily at home’’ allows for the pos- 
sibility that children who were schooled partly at 
home and partly at school were not identified as 
home schooled. NHES:96 PFI/CI interviewers 
first asked whether children were enrolled and 
then asked, regardless of enrollment status, 
whether children were schooled at home. When 
respondents indicated that a child was home 
schooled, the interviewer clarified the response by 
asking whether the child was schooled at home 
“instead of at school.” It is not clear how parents 
who schooled their children partly at home and 
partly at school might have responded to these 
items. 

In addition to the difference in wording dis- 
cussed above, the number of items and the com- 
plexity of their sequence are considerably greater 
in CPS:Oct94 than in NHES, creating more op- 
portunities for missing or inaccurate responses. 
Although the greater number and complexity of 
the items in CPS:Oct94 does not appear to have 
affected response rates, as they were consistently 
high, whether it affected the quality of responses 
cannot be determined with the available data. 



Respondent Fatigue 

When surveys become too long, respondents 
often begin to tire or lose interest, a phenomenon 
known as “respondent fatigue.” As a consequence 
of this fatigue, questions near the end of a long 
survey often have higher rates of nonresponse and 
responses to these questions can be less accurate 
than responses to questions near the beginning of 
the survey. 

The issue of respondent fatigue was addressed 
because the CPS education supplement questions 
regarding children’s schooling occur near the end 
of the interview, after the basic labor force and 
supplement items for adults are asked. In contrast, 
the NHES items regarding children’s schooling 
occur at the very beginning of the PFI/CI inter- 
view. 

It appears unlikely that this difference has af- 
fected these data. As noted above, the response 
rates to the supplement items regarding home 
schooling are high, which indicates that fatigue 
did not affect response rates greatly. In addition, 
in CPS:Oct94, household interviews that included 
supplement interviews for children aged 6 to 17 
years old averaged 15 minutes in length. Given 
this relatively short duration, fatigue is not likely 
to have been a problem. However, whether fa- 
tigue did occur and affected the quality of re- 
sponses cannot be determined with these data. 1 

Respondent Error 

Respondents’ knowledge of the survey topic 
affects their ability to answer questions accurately. 
Therefore, respondents’ relationships to the chil- 



1 Although the NHES:96 PFI/CI interviews were longer — 19 
minutes in addition to the 6-minute Screener interview — the 
home-schooling questions were asked at the beginning of the 
extended interview and are thus relatively safe from the ef- 
fects of respondent fatigue. 
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dren about whom the home-schooling questions 
were asked may affect the accuracy of their an- 
swers. In addition, the political and cognitive 
contexts within which questions are asked and 
answered may affect respondents’ answers. 

Respondents ’ Relationships to Children 

The CPS:Oct94 respondents could be different 
from the respondents to the NHES PFI/CI inter- 
views because the instructions given to interview- 
ers for choosing respondents differed between the 
two surveys. In CPS:Oct94, any household mem- 
ber 15 years old or older was eligible to respond 
for all household members, although interviewers 
were instructed to interview the most knowledge- 
able adult in the household if possible. In 
NHES: 96 PFI/CI, interviewers asked to speak to 
the parent or guardian who knew most about the 
sampled child’s education. Respondents were re- 
quired to be 18 years old or older. 

It is not possible to establish empirically 
whether and how the respondents for the two 
studies differed. Although data regarding the rela- 
tionship of the respondent to the child are avail- 
able for all children in NHES, these data are 
available only for 15- to 17-year-olds in CPS. The 
available data indicate that parents were the most 
frequent respondents in both surveys, and it seems 
quite likely that if parents were the most common 
respondents for 15- to 17-year-olds in CPS:Oct94, 
they would also be so for younger children. 

Political/Legal and Cognitive Contexts 

The political/legal and cognitive contexts 
within which surveys are conducted can affect 
respondents’ answers to particular questions. 
Home-schooling researchers have suggested that 
home-schooling families may be more reticent 



than others to participate in government research, 
particularly research that might address the issue 
of home schooling, because of the often ambigu- 
ous legal status of home schooling (Kaseman and 
Kaseman 1991; Ray 1997). On the other hand, to 
the degree that in recent years parents have be- 
come more interested in home schooling and in 
working with schools and districts to facilitate 
home schooling, there may be less reason for con- 
cern in this regard. 

The household- and item-level response rates 
provide relevant but conflicting evidence in this 
regard. The household response rate for NHES:96 
(which respondents were told was sponsored by 
the U.S. Department of Education and concerned 
education issues) was lower than the correspond- 
ing rate for CPS:Oct94 (which was conducted by 
the Census Bureau and which respondents were 
told covered labor force participation issues). This 
is consistent with the hypothesis that home- 
schooling parents may be more reluctant to dis- 
cuss education issues, although the impact of the 
lower household response rate is somewhat miti- 
gated because 30 percent of households, not 100 
percent, are likely to include school-aged children. 
The high item response rates in both surveys indi- 
cate that respondents in participating households 
were no less likely to discuss home schooling than 
other issues. Unfortunately, whether the politi- 
cal/legal context of home schooling affected the 
quality of response cannot be determined with the 
existing data. 

The cognitive context may also have been af- 
fected by the different sponsors and purposes of 
the two surveys. In general, participating respon- 
dents want to cooperate with interviewers, and in 
their attempts to do so, use all available informa- 
tion to determine what the interviewer wants to 
know so they can provide the best information. 
Therefore, respondents are likely to have consid- 
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ered the different sponsors when they responded 
to questions, although any particular effects of 
these considerations upon their responses cannot 
be predicted or measured. 

Impact of Data Processing Errors 

Whereas the NHES:96 PFI/CI interview in- 
cluded on-line edits and all NHES:96 data were 
edited after data collection concluded, the 
CPS:Oct94 supplement did not include on-line 
edits and the home-schooling items were not ed- 
ited after data collection. As noted above, without 
editing some cases could not be included in the 
CPS:Oct94 analysis due to missing information. 
Furthermore, not correcting errors that could be 
identified through consistency and plausibility 
checks in the CPS data may have contributed ad- 
ditional error to the CPS:Oct94 estimates relative 
to the NHES:96 estimates. The available data do 
not permit estimation of the direction or magni- 
tude of this potential error in this instance. 

Conclusion 

This study examined several differences be- 
tween the methods used in the CPS:Oct94 and 
NHES:96 that might contribute to the observed 



difference in the two surveys’ estimates of the 
number and proportion of home-schooled chil- 
dren. The potential direction and magnitude of 
estimate differences could not be predicted for 
most of these methodological differences between 
the surveys, however. 

This study raises a number of research ques- 
tions regarding survey research and home school- 
ing. First, it would be useful for researchers to 
address whether and how the political context of 
home schooling or other factors affect respon- 
dents’ willingness to participate in the respective 
surveys and the accuracy of their answers to ques- 
tions about home schooling. Second, research 
should explore the variety of schooling arrange- 
ments — exclusively at home, exclusively at 
school, and various combinations thereof — that 
parents make for their children, the frequency of 
these arrangements, and the factors that affect the 
kind of arrangement parents choose. Third, the 
results of cognitive laboratory research into par- 
ents’ understanding of the term “home schooling” 
would aid in interpretation of responses to survey 
questions. Future research — using the NHES:99 
data or cognitive laboratory studies of alternative 
question wording, for example — may address 
some of the issues raised in this report. 
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Foreword 



In 1994 and 1996 two national surveys — the October 1994 Current Population Survey, 
conducted by the U.S. Bureau of the Census, and the 1996 National Household Education Sur- 
vey, conducted by the National Center for Education Statistics — asked representative, national 
samples of households a series of questions regarding home schooling in the United States. Al- 
though it is believed to be a growing phenomenon, home schooling remains a relatively rare 
event, and therefore difficult to study with precision. This study was undertaken to compare the 
methods used in the two surveys and study the possible effects of differences in survey methods 
on estimates of the number and proportion of U.S. children who are home schooled. The results 
of this study have already been used to improve data collection on home schooling in the 1999 
National Household Education Survey, and will influence future research on the topic with na- 
tional survey data. 



O 

ERIC 



X 



14 



Acknowledgments 



A great many people contributed to the completion of this report. At MPR Associates, Tim 
Urdan contributed to the literature review and early conceptualization of the project. Ellen Lieb- 
man wrote the programs that analyzed much of the data, and Susan Choy added helpful sugges- 
tions at a point when they were most needed. Andrea Livingston edited the report, Francesca 
Tussing created the tables and figures, and Barbara Kridl managed its final production. 

At the U.S. Census Bureau, Rosalind Bruno, Timothy Marshall, and Ronald Tucker pro- 
vided helpful information at key points during report production. At NCES, Dan Kaspryzk’s 
knowledge, experience, and commentary improved the report immeasurably. Tom Snyder, Bruce 
Taylor, and Beth Aronstamm Young reviewed the report near its completion and also provided 
many useful suggestions. 

Several others reviewed the report at various stages. Leslie Scott of the Education Statisti- 
cal Services Institute provided a thorough technical review, and final reviewers included Jack 
Klenk of the U.S. Department of Education’s Office of Non-Public Education; Patricia Lines, 
formerly of the Department of Education; Brian Ray of the National Home Education Research 
Institute, and Scott Somerville of the Home Schooling Legal Defense Association. Their contri- 
butions are much appreciated. 



O 

ERIC 



XI 



15 . 



Table of Contents 



Page 



Executive Summary iii 

Foreword x 

Acknowledgments xi 

List of Tables xv 

List of Figures xvii 

1. Introduction 1 

2. Data Sources 5 

2.1 Current Population Survey (CPS:Oct94) 5 

2.2 National Household Education Survey (NHES:96) 6 

3. Comparison of Home-Schooling Estimates 9 

3. 1 Characteristics of Children 12 

3.2 Characteristics of Families 12 

4. Impact of Nonobservational Errors 15 

4. 1 Sample Coverage 15 

4.1.1 Sampling Frames 15 

4. 1.1.1 CPS:Oct94 15 

4. 1.1.2 NHES:96 19 

4.1.2 Sampling Among and Within Households 22 

4. 1.2.1 CPS:Oct94 22 

4.1. 2. 2 NHES:96 23 

4.2 Response Rates 24 

4.2.1 CPS:Oct94 24 

4.2. 1.1 Survey Response Rate 24 

4.2. 1.2 Supplement Response Rate 26 

4.2. 1.3 Item Response Rates 26 

4.2.2 NHES:96 28 

4.2.2. 1 Survey Response Rate 28 

4. 2.2. 2 Interview Response Rate 29 

4.2.2. 3 Item Response Rates 3 1 



O 

ERIC 



16 



Table of Contents 



Page 



4.3 Conclusion on Nonobservational Errors 31 

5. Impact of Observational Errors 35 

5.1 Data Collection Procedures and Potential Associated Error 35 

5.2 Instrument Error 37 

5.2. 1 Question Wording 37 

5.2.1. 1 CPS:Oct94 37 

5. 2. 1.2 NHES:96 40 

5.2.2 Question Sequencing 40 

5.2.3 Location of Home-Schooling Item’s and Respondent Fatigue 42 

5.3 Respondent Error 43 

5.3.1 Respondents’ Relationships to Children 44 

5.3.2 Political and Legal Contexts 45 

5.3.3 Cognitive Context 46 

5.4 Conclusion on Observational Errors 47 

6. Data Processing Errors 49 

7. Conclusion 51 

8. References 55 

Appendix A — Technical Notes 59 

Appendix B — Standard Error Tables 81 



O 

ERIC 



XIV 



17 



List of Tables 



Table Page 

Text Tables 

1 CPS:Oct94 and NHES:96 estimates of the number and percentage of 6- to 17-year- 

olds who were home schooled in grades K-12 and difference between estimates 10 

2 CPS:Oct94 estimates of the number of 6- to 17-year-olds enrolled in school or home 

schooled in grades K-12, percentage home schooled, undercoverage rate, and 
percentage and number overestimated, assuming no home schooling among 
undercovered population, by age, race/ethnicity, and sex 17 

3 CPS:Oct94 estimates of the number of 6- to 17-year-olds enrolled in school or home 
schooled in grades K-12, percentage home schooled, undercoverage rate, and 
percentage and number underestimated, assuming rate of home schooling among 
undercovered population is three times the observed rate, by age, race/ethnicity, and 



sex 18 

4 CPS:Oct94 estimates of the number of 6- to 17-year-olds who were enrolled in school 

or home schooled in grades K-12 and percentage who were home schooled, by 
whether telephone in household 20 

5 Weighted CPS:Oct94 response rates for selected items 27 

6 Weighted NHES:96 PFI/CI response rates for selected items 32 

7 NHES:96 estimates of the percentage distribution of 6- to 17-year-olds according to 

relationship to interview respondent, by home-schooling status 45 

8 CPS:Oct94 estimates of the percentage distribution of 15- to 17-year-olds according 

to relationship to interview respondent, by home-schooling status 45 

9 Differences between data sources, by type of error 52 

Appendix Tables 

A1 CPS:Oct94 estimates of the number and percentage distribution of 15- to 17-year-olds 
according to whether emancipated minor and number and percentage distribution of 
emancipated minors according to home-schooling status 61 




xv 




List of Tables 



Table Page 



A2 CPS:Oct94 and NHES:96 estimates of the number and percentage of home-schooled 
6- to 17-year-olds, by persons providing education and whether schooled at home 
because of illness or disability 63 

A3 Estimating impact of missing data on CPS.Oct 94 estimates 64 

A4 CPS:Oct94 estimates of the number of nonenrolled children and percentage 

distribution according to age, by eligibility for home-schooling analysis 65 

B1 Standard errors for table 1: CPS:Oct94 and NHES:96 estimates of the number and 

percentage of 6- to 17-year-olds who were home schooled in grades K-12 83 

B2 Standard errors for tables 2 and 3: CPS:Oct94 estimates of the number of 6- to 17- 
year-olds enrolled in school or home schooled in grades K-12 and percentage who 
were home schooled, by age, race/ethnicity, and sex 85 

B3 Standard errors for table 4: CPS:Oct94 estimates of the number of 6- to 17-year-olds 
who were enrolled in school or home schooled in grades K-12 and percentage who 
were home schooled, by whether telephone in household 86 

B4 Standard errors for table 7: NHES:96 estimates of the percentage distribution of 6- to 
17-year-olds according to relationship to interview respondent, by home-schooling 
status 87 



B5 Standard errors for table 8: CPS:Oct94 estimates of the percentage distribution of 15- 
to 17-year-olds according to relationship to interview respondent, by home-schooling 



status 88 

B6 Standard errors for table Al: CPS:Oct94 estimates of the number and percentage 
distribution of 15- to 17-year-olds according to whether emancipated minor and 
number and percentage distribution of emancipated minors according to home- 
schooling status 89 

B7 Standard errors for table A2: CPS:Oct94 and NHES:96 estimates of the number and 
percentage of home-schooled 6- to 17-year-olds, by persons providing education and 
whether schooled at home because of illness or disability 90 

B8 Standard errors for table A3: Estimating impact of missing data on CPS: Oct 94 

estimates 91 

B9 Standard errors for table A4: CPS:Oct94 estimates of the number of nonenrolled 
children and percentage distribution according to age, by eligibility for home- 
schooling analysis 92 



ERIC 



XVI 



19 



List of Figures 



Figure Page 



A CPS:Oct94 and NHES:96 point estimates and their 95-percent confidence intervals of 

number of home-schooled 6- to 17-year-olds iii 

1 CPS:Oct94 and NHES:96 point estimates and their 95-percent confidence intervals of 

number of home-schooled 6- to 17-year-olds 2 

2 Disposition of sampled households and household members eligible for Education 

Supplement in CPS:Oct94, including response rates 25 

3 Disposition of sampled telephone numbers and of children sampled for the PFI/CI 

interview in NHES:96, including response rates 30 

4 Items related to home schooling in CPS:October 1994 interview, by subject age and 

enrollment status 38 

5 Items related to home schooling in NHES:96 interview 41 

A1 CPS:Oct94 items regarding reason for not attending regular school and NHES:96 

items regarding reasons for home schooling 62 



O 

ERLC 



XVII 



20 



1. Introduction 



Home schooling in the United States has become a topic of interest to education policy- 
makers, administrators, and the general public. For policymakers and education administrators, 
home schooling raises issues regarding whether and how to regulate parents’ education of their 
children at home and the types of services school districts can and should provide to home- 
schooling parents and their children. For example, when school voucher initiatives were pro- 
posed in Colorado, legislators discussed whether home-schooled children should receive vouch- 
ers as well as their private school educated peers (Walsh 1998). Also, administrators in higher 
education are determining how to assess home-schooled students’ qualifications when making 
admissions decisions (Belluck 1998; Shea 1996). Many of these issues concern taxpayers and 
citizens at large, and therefore, the general public also has substantial interest in home-schooling 
policy discussions. Informed discussions of home-schooling policy are compromised without ac- 
curate estimates of how many children are educated at home and whether the proportion of chil- 
dren who are so educated is changing. 

However, measuring the prevalence of home schooling in the United States has proven to 
be a difficult task. Estimates of the number of children who are home schooled vary by hundreds 
of thousands of children. In the last decade, there have been several attempts to determine the 
number of children who are home schooled. Some studies have attempted to assess the size of 
the home-schooled population by identifying and surveying home-schooling families and ex- 
trapolating from those surveys estimates of the number of children who are schooled at home. 
Other researchers have collected data from state administrative records to develop estimates. All 
of these estimates, over time, have ranged from 200,000 children in 1988 (Kohn 1988) to 1.15 
million children in 1995 (Ray 1997). However, most of these researchers recognize that their es- 
timates of the number of home-schooled children include unknown sources of error (Kohn 1988; 
Lines 1991, 1996, 1998; Ray 1997). 

In order to overcome some of the weaknesses of these studies and obtain accurate estimates 
of the number of children who are home schooled, two surveys with large, representative samples 
of the U.S. population included questions regarding home schooling: the 1994 October supple- 
ment to the 1994 Current Population Survey (CPS:Oct94) and the 1996 National Household 
Education Survey (NHES:96). However, although these surveys used scientific sampling meth- 
ods, they have produced quite different results. The point estimates derived from these data sets 
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were 345,000 6- to 17-year-olds in CPS:Oct94 and 636,000 6- to 17-year-olds in NHES:96. The 
95-percent confidence interval around the CPS:Oct94 point estimate ranges from 287,000 to 
402,000, and the 95-percent confidence interval from 515,000 to 757,000 around the NHES:96 
point estimate (figure 1). 



Figure 1 — CPS:Oct94 and NHES:96 point estimates and their 95-percent confidence intervals of number of 
home-schooled 6- to 17-year-olds 



Number of home- 
schooled 6- to 17- 
year-olds 




SOURCE: U.S. Department of Commerce, Bureau of the Census, Current Population Survey, October 1994 (CPS:Oct94); 
U.S. Department of Education, National Center for Education Statistics, National Household Education Survey of 1996, 
Parent and Family Involvement/Civic Involvement Component (NHES:96, PFI/CI). 



Although the differences between these two surveys’ point estimates may reflect true 
growth in the proportion of students being home schooled between October 1994 and January 
through April 1996, it seems unlikely that the number of home-schooled children nearly doubled 
in less than two years (Ray 1999; Lines 1998). However, other differences between the CPS and 
the NHES, such as variation in question wording, make it impossible to determine whether the 
incidence of home schooling changed this dramatically between the two data collections. The 
purpose of this report is to explore differences in the designs and executions of the two surveys 
that may have contributed to the different estimates of the number of children who were home 
schooled. 

This report is based on the premise that for any given year there is some “true” number of 
home-schooled children in the population. Point estimates derived from the CPS and NHES de- 
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part from this true value by some amount of error. Errors in surveys include errors in nonobser- 
vation, errors in observation, and data processing errors (Groves 1991). 1 After describing the data 
sources and presenting more details concerning the estimates, this report examines each type of 
error. First, the report explores differences between the surveys in the potential for nonobserva- 
tion errors. These nonobservational errors are classified into two sources: errors in sample cover- 
age and errors due to nonresponse. Next, the report examines potential sources of observational 
errors within the surveys, including errors associated with the data collection design, instrument 
error, and respondent error. Finally, the report examines the potential for error in the data proc- 
essing of each survey. 



’in this report, “error” is used to denote both random and nonrandom errors. “Bias” is also used to denote nonrandom error, e.g., 
“nonresponse bias.” 



2. Data Sources 



This report examines data from the 1994 October Supplement to the Current Population 
Survey (CPS:Oct94) and the 1996 National Household Education Survey (NHES:96), surveys 
that resemble and differ from each other in a number of ways. Although most of this report dis- 
cusses these similarities and differences in detail, this section provides a brief overview of the 
surveys. 

2.1 Current Population Survey (CPS:Oct94) 

Each month for over 50 years the Census Bureau has conducted the CPS, primarily to 
collect national data on labor force participation. Education is strongly related to several aspects 
of labor force participation, and therefore, questions on adults’ education attainment are included 
among the questions that are asked each month, which are referred to as the “basic” survey or 
items. Supplements to the basic labor force participation survey focus on different topics each 
month. The October survey’s supplement focuses on civilian participation in education programs 
each year, and includes separate instruments regarding the enrollment of children (ages 3 to 14) 
and adults (ages 15 and older). In October 1994, the education supplement to the CPS included 
additional questions on home schooling in both the adult and child instruments. 

The CPS sample is selected from addresses from the previous Decennial Census and up- 
dates from building permits and other information sources. Sampled housing units are in the 
sample for 8 months out of 16 consecutive months: in 4 months, out 8 months, and in again dur- 
ing the same 4 months of the following year. The first and fifth month’s interviews are conducted 
in person, and the remainder by telephone if the household agrees to telephone interviews. Most 
households’ interviews are conducted by telephone, either by staff at one of three telephone cen- 
ters or by the CPS personal interviewer who originally interviewed the household. Any house- 
hold member 15 years old or older can serve as the respondent, although interviewers attempt to 
interview the most knowledgeable person in the household. Labor force participation data are 
collected regarding each household member 16 years old and older. Supplement data are col- 
lected about each household member for whom the questions are appropriate. In the case of the 
education supplement, questions regarding school enrollment are asked about all household 
members 3 years old and older (U.S. Department of Commerce 1999; U.S. Department of Labor 
1997). 
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In January 1994 CPS began using computer-assisted personal interviewing (CAPI) and 
computer-assisted telephone interviewing (CATI) to collect data. In CAPI, field staff have laptop 
computers with them when they conduct the household interview. Similarly, in CATI, interview- 
ers use computers to conduct interviews over the phone. In both CAPI and CATI, computer pro- 
grams take interviewers through the questionnaire, preventing errors in skip pattern 
implementation. CAPI/CATI programs also can be programmed for on-line editing in which an- 
swers provided in previous interviews or earlier in the current interview can be confirmed or ap- 
plied in subsequent questions, reducing errors and response burden. Furthermore, conflicts 
between responses can be resolved with the respondent, rather than during post survey edits. 2 
CPS data are collected during the week that includes the 19th of each month, and are asked re- 
garding the previous week, i.e., the week including the 12th. 

2.2 National Household Education Survey (NHES:96) 

The U.S. Department of Education’s National Center for Education Statistics (NCES) be- 
gan collecting data through the NHES in 1991, and since then has administered the survey in 
1993, 1995, 1996, and 1999. NHES was developed to collect information on education-related 
issues that are not easily studied through institution-based surveys. Such issues include the use of 
nonparental childcare, participation in early childhood education programs, parents’ and families’ 
involvement in children’s education, and school readiness. Topics are rotated among survey ad- 
ministrations to allow monitoring of trends over time (see NHES Web site, 
http://www.nces.ed.gov/nhes, for details). The NHES data used in this report were collected in 
the Parent and Family Involvement/Civic Involvement (PFI/CI) component of NHES:96. 3 

Households are selected for participation in NHES through random digit dialing of tele- 
phone numbers from January through April of the administration year. Households without tele- 
phones are excluded from the sample. Using CATI, interviewers in telephone centers conduct the 
interviews, beginning with Screener interviews that determine whether sampled telephone num- 
bers serve a residence, and if so, whether household members are eligible to be sampled for ex- 
tended topical interviews. 

Screener respondents must be at least 18 years old or the head of the household, and ex- 
tended-interview respondents are chosen in accordance with the population chosen for each ex- 



2 Section 6 discusses the editing (on-line and post-data-collection) procedures used in CPS:Oct94 and NHES:96. 

3 The NHES:95 Early Childhood Program Participation (ECPP) interview also included questions regarding home schooling. 
The ECPP interview was conducted regarding a sample of children who were in grades three or below and no older than age 10. 
In contrast, the NHES:96 PFI/CI interview was conducted on a sample of children enrolled in grades 12 and below and no older 
than age 20, a population that can be replicated (for the most part) with CPS:Oct94 data. Therefore, this report focuses on the 
CPS:Oct94 and NHES:96 data. 
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tended interview. The population of interest for the 1996 PFI/CI interview was children age 3 to 
12th grade, with a maximum age of 20. These children were sampled for the interviews based on 
information gathered from the Screener. When a child in the household was selected for the ex- 
tended-interview sample, the interviewer asked to speak with the parent or guardian who knew 
the most about the child’s education in order to conduct the PFI/CI interview. 



3. Comparison of Home-Schooling Estimates 



The population of children chosen for this analysis is 6- to 17-year-olds who 1) lived with a 
parent, guardian, or nonrelative at least 12 years older than the child; 2) had neither graduated 
from high school nor earned a GED; and 3) were reported to be in kindergarten through grade 12, 
the equivalents thereof, or an ungraded class or level of instruction. The age and grade limitations 
were imposed partly to restrict the study to children who were expected to be enrolled in school 
across the nation. Therefore, 5-year-olds were excluded because the modal grade for 5-year-olds 
is kindergarten and enrollment in kindergarten is not required in all states. Similarly, children 
who had already earned a high school diploma or GED were excluded because they were no 
longer required to attend school. 

In addition to including only children expected to be in school, other sample limitations 
were imposed due to choices made by the data collectors. In the NHES, parents of 6-year-olds 
who were in preschool were not asked the questions relating to home schooling, and parents of 
youth who were 18 years old or older were likewise not taken through the items about home 
schooling. Therefore, these groups were excluded from analyses of the CPS:Oct94 data because 
they were not captured in the NHES:96 data collection. 4 

Table 1 displays the estimated number of home-schooled children and percentage of all 
children who were home schooled from CPS:Oct94 and NHES:96. 5 Column 5 of table 1 shows 
the absolute differences between the two data sources in the number of home-schooled children. 
Column 6 shows the percentage difference between the estimated number of home-schooled 
children as derived from the two data sources. For example, the first row shows that the point 
estimates of the number of 6- to 17-year-olds in kindergarten through grade 12 who were home 



Emancipated minors — defined as children not living with someone identified as a parent or guardian or who was at least 12 
years older than the child and not the child’s spouse — were not included in the population of interest for the PFI/CI interview. 
Although the NHES definition of emancipated minors could not be replicated with the CPS data, analyses of the CPS data indi- 
cated that very few 15- to 17-year-olds were living alone or with a spouse, and none of them was home schooled. See appendix A 
for further details regarding this issue. 

^Both surveys allowed distinction between children who were schooled at home for various reasons, including illness or disabil- 
ity. In addition, CPS:Oct94 included a question about whether the home-schooled child’s instructor was a member of the school 
district staff or a parent or person employed by the parent. One might argue that children who were schooled at home because of 
illness or disability or by school personnel should not be included in estimates regarding home-schooled children. Relatively few 
children fell into this category, however, and therefore they were included in the estimates presented in this report. See appendix 
A for further discussion of this issue. 
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Table 1 — CPS:Oct94 and NHES:96 estimates of the number and percentage of 6- to 17-year-olds who were 
home schooled in grades K-12 and difference between estimates 



Difference between NHES:96 
and CPS:Oct94 estimates 





CPS (October 1994) 
Number Percent 

educated educated 
at home at home 


NHES:96 (Spring 1996) 
Number Percent 

educated educated 
at home at home 


Number 

(NHES:96 

minus 

CPS:Oct94) 


Difference as 
percent of 
NHES:96 
estimate 


Total 


345,000 


0.8 


636,000 


1.4 


292,000 


45.9 


Sex 


Male 


161,000 


0.7 


268,000 


1.1 


107,000 


39.9 


Female 


183,000 


0.9 


368,000 


1.7 


185,000 


50.3 


Race/ethnicity 


White, non-Hispanic 


316,000 


1.1 


552,000 


1.8 


236,000 


42.8 


Black, non-Hispanic 


10,000' 


0.2 


14,000' 


0.2 


4,000 


28.6 


Hispanic 


16,000' 


0.3 


51,000' 


0.9 


35,000 


68.6 


All others 


3,000' 


0.2 


20,000' 


1.0 


17,000 


85.0 


Age 


14 and younger 


290,000 


0.9 


455,000 


1.3 


165,000 


36.3 


6 


42,000' 


1.1 


31,000' 


0.8 


-10,000 


-32.3 


7 


40,000' 


1.1 


43,000' 


1.1 


3,000 


7.0 


8 


36,000' 


1.0 


60,000' 


1.5 


25,000 


41.7 


9 


44,000' 


1.2 


59,000' 


1.6 


14,000 


23.7 


10 


29,000' 


0.8 


46,000' 


1.1 


17,000 


37.0 


11 


41,000' 


1.1 


51,000' 


1.3 


10,000 


19.6 


12 


16,000' 


0.4 


53,000' 


1.4 


36,000 


67.9 


13 


20,000' 


0.5 


50,000' 


1.3 


31,000 


62.0 


14 


22,000' 


0.6 


62,000' 


1.7 


40,000 


64.5 


15 to 17 


55,000 


0.6 


181,000 


1.6 


127,000 


70.2 


15 


26,000' 


0.7 


69,000' 


1.8 


43,000 


62.3 


16 


4,000' 


0.1 


65,000' 


1.7 


60,000 


92.3 


17 


24,000' 


0.8 


47,000' 


1.4 


23,000 


48.9 


Family income 2 


Less than $20,000 


87,000 


0.8 


177,000 


1.4 


90,000 


50.8 


$20,000-34,999 


80,000 


0.8 


172,000 


1.7 


93,000 


54.1 


$35,000-49,999 


90,000 


1.1 


142,000 


1.6 


52,000 


36.6 


$50,000 or more 


89,000 


0.7 


146,000 


1.0 


57,000 


39.0 


Father’s education attainment 


Unknown 


32,000' 


0.3 


158,000 


1.0 


126,000 


79.7 


No high school diploma 


17,000' 


0.4 


56,000' 


1.4 


39,000 


69.6 


High school diploma 


74,000 


0.7 


73,000 


0.8 


-1,000 


-1.4 


Some postsecondary education 


101,000 


1.2 


189,000 


2.5 


87,000 


46.0 


Bachelor’s degree 


84,000 


1.6 


89,000 


1.7 


4,000 


4.5 


Graduate degree 


35,000' 


1.1 


72,000* 


1.9 


37,000 


51.4 
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Table 1 — CPS:Oct94 and NHES:96 estimates of the number and percentage of 6- to 17-year-olds who were 
home schooled in grades K-12 and difference between estimates — Continued 

Difference between NHES:96 
and CPS:Oct94 estimates 





CPS (October 1994) 
Number Percent 

educated educated 
at home at home 


NHES:96 (Spring 1996) 
Number Percent 

educated educated 
at home at home 


Number 

(NHES:96 

minus 

CPS:Oct94) 


Difference as 
percent of 
NHES:96 
estimate 


Mother’s education attainment 


Unknown 


11,000' 


0.6 


49,000' 


1.2 


38,000 


77.6 


No high school diploma 


27,000' 


0.4 


82,000' 


1.2 


55,000 


67.1 


High school diploma 


100,000 


0.7 


132,000 


1.0 


32,000 


24.2 


Some postsecondary education 


133,000 


1.1 


251,000 


2.0 


117,000 


46.6 


Bachelor’s degree 


64,000 


1.2 


97,000 


1.5 


33,000 


34.0 


Graduate degree 


10,000' 


0.5 


26,000' 


1.0 


16,000 


61.5 


Highest parental education attainment 
Unknown 5,00c) 1 




(t) 


(t) 


(t) 


(t) 


No high school diploma 


22,000' 


0.4 


42,000' 


1.0 


20,000 


47.6 


High school diploma 


59,000 


0.5 


134,000 


1.0 


75,000 


56.0 


Some postsecondary education 


130,000 


1.0 


243,000 


1.8 


113,000 


46.5 


Bachelor’s degree 


87,000 


1.3 


130,000 


1.8 


42,000 


32.3 


Graduate degree 


41,000' 


0.9 


87,000 


1.3 


46,000 


52.9 


Number of parents 


Mom and dad 


(t) 


(t) 


504,000 


1.6 


(t) 


(t) 


Mom only 


(t) 


(t) 


100,000' 


0.9 


(t) 


(t) 


Dad only 


(t) 


(t) 


11,000' 


0.8 


(t) 


(t) 


Nonparent guardian 


(t) 


(t) 


21,000' 


1.3 


(t) 


(t) 


Number of children in family 


One 


(t) 


(t) 


98,000 


1.3 


(t) 


(t) 


Two 


(t) 


(t) 


157,000 


0.9 


(t) 


(t) 


Three 


(t) 


(t) 


187,000 


1.4 


(t) 


(t) 


Four or more 


(t) 


(t) 


194,000 


2.7 


(t) 


(t) 


Region 


Northeast 


68,000 


0.9 


81,000 


0.9 


13,000 


16.0 


South 


125,000 


0.8 


207,000 


1.3 


82,000 


39.6 


Midwest 


55,000 


0.5 


153,000 


1.4 


98,000 


64.1 


West 


97,000 


1.0 


196,000 


2.0 


99,000 


50.5 



—Denominator sample size too small for a reliable estimate. 
fNot available. 

Sample size too small for a reliable estimate. Interpret with caution. 

2 The income variable for the NHES was household income rather than family income, as in CPS. In addition, the income 
categories for the NHES were defined slightly differently, as follows: $20,000 or less; $20,001-35,000; $35,001-50,000; and 
$50,001 or more. 

NOTE: Total numbers are rounded to the nearest thousand. Details may not sum to totals due to rounding. 

SOURCE: U.S. Department of Commerce, Bureau of the Census, Current Population Survey, October 1994 (CPS:Oct94); 
U.S. Department of Education, National Center for Education Statistics, National Household Education Survey of 1996, 
Parent and Family Involvement/Civic Involvement Component (NHES:96, PFI/CI). 



3. Comparison of Home-Schooling Estimates 



schooled were 345,000 in CPS:Oct94 and 636,000 in NHES:96. The estimate from the NHES 
data is thus 292,000 children and 46 percent more than that from CPS. 



3.1 Characteristics of Children 

The data indicate that there were differences in the home-schooling rate by children’s sex, 
race/ethnicity, and age. However, the findings were not always consistent across the two data 
sets. Although the CPS:Oct94 data indicate that there was no difference in the rates at which 
boys and girls were home schooled, the NHES:96 data indicate that girls were more likely than 
boys to be home schooled. 

With respect to race/ethnicity, the CPS data indicate that white, non-Hispanic 6- to 17-year- 
olds were more likely than others to be home schooled. In addition, the NHES data indicate that 
white, non-Hispanic 6- to 17-year-olds were more likely to be home schooled than black, non- 
Hispanic and Hispanic 6- to 17-year-olds. 

Finally, with respect to age, the CPS:Oct94 data indicate that children younger than 15 
were more likely to be home schooled than were children 15 and older. However, the NHES data 
indicate that there was no difference in the home-schooling rates of children in these two age 
groups. 

3.2 Characteristics of Families 

As with the characteristics of children, whether some characteristics of families are associ- 
ated with differential rates of home schooling depends on which data set one consults. Both data 
sets indicate that children in families with higher incomes were more likely to be home schooled. 
However, the NHES data also indicate that at the highest income level, the rate of home school- 
ing declines. Although this also appears to be the case in the CPS data, the statistical tests do not 
support this conclusion. 

Findings regarding the relationship between home schooling among children and their par- 
ents’ education vary between the two data sets. The CPS data indicate that the rate of home 
schooling among 6- to 17-year-old children was related to their parents’ (whether fathers’, moth- 
ers’, or the highest of either parent) level of education attainment. With respect to fathers’ and 
the highest of the two parents’ education attainment, the relationship was positive in that the 
more educated the parent the more likely the child was home schooled. With respect to mothers’ 
education attainment, children whose mothers had graduate degrees were home schooled at a 
lower rate than were children whose mothers did not have a graduate degree. In contrast, how- 
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3. Comparison of Home -Schooling Estimates 



ever the NHES data indicate no linear relationship between the rate of home schooling and chil- 
dren’s fathers’, mothers’, or highest parental education attainment. 

The NHES:96 data indicate that children who lived with two parents were no more likely 
than children who lived with only one parent or a nonparent guardian to be home schooled. 
However, children in families of four or more children were more likely than children in two- 
child families to be home schooled. 

Finally, neither the CPS:Oct94 nor the NHES:96 data indicate that home schooling is more 
common in some parts of the country than in others. Although in each data set it appears as if 
children in the West were more likely than children in other regions to be home schooled, these 
differences were not statistically significant. 

Beginning with the next section, the remainder of the report discusses the estimated or po- 
tential impact of several types of error on the difference between the two surveys’ point esti- 
mates. Section 4 addresses nonobservational errors, section 5 observational errors, and section 6 
data processing errors. 
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4. Impact of Nonobservational Errors 



Nonobservational errors result from missing portions of the targeted population. These er- 
rors can occur for a variety of reasons. In simple terms, if members of the targeted population are 
excluded from the sample frame, i.e., not covered by the sample frame, the sample cannot repre- 
sent them, and therefore cannot represent the entire population. Similarly, if some members of 
the sample are less likely than others to participate in the survey, i.e., if there are low response 
rates overall or among certain groups, response bias may occur because some sample members’ 
information is less well represented. Thus, issues of sample coverage and response rates are ex- 
amined in this section. 

4.1 Sample Coverage 

The validity of estimates derived from a sample survey depends a great deal on the quality 
of the sampling frame and the sample design. The degree to which the sampling frame, that is, 
the list of population members from which the sample is drawn, covers all segments of the de- 
sired population affects the quality of the sample drawn from that frame. Equally adequate 
frames, however, can yield samples of greater or lesser quality depending on the design for 
drawing the sample. This section discusses the sampling frames and sample designs used in these 
studies. 

4.1.1 Sampling Frames 

Both the CPS:Oct94 and NHES:96 sampled children by sampling households, although 
they drew their samples of households from quite different sampling frames. This section dis- 
cusses the differences between the sampling frames and the potential for, and potential effects of, 
biases introduced by these differences. 

4.1. 1.1 CPS:Oct94 

The CPS sampling frame is the list of addresses used in the most recent Decennial Census 
updated using building permits in order to capture housing units created since that Census. Using 
data from the 1990 Decennial Census, the Census Bureau estimates that the overall undercover- 
age rate, that is, the proportion of individuals omitted from the frame due to missed housing units 
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and missed persons within sampled households, is 8 percent (U.S. Department of Commerce 
1994, Attachment 18). The undercoverage rate for children under 15 years old is 7 percent, for 
15-year-olds it is 10 percent, and for 16- to 19-year-olds it is 13 percent. 

Among noninstitutionalized children under 20 years old, Census Bureau research indicates 
that the rate of undercoverage varies with sex, race/ethnicity, and age. Rates for males are typi- 
cally higher than those for females, rates for blacks are higher than those for nonblacks, and rates 
for older children are typically higher than those for younger children. The lowest rate of under- 
coverage reported is 4 percent among nonblack females under age 15, and the highest rate is 29 
percent among black males between 16 and 19. years old, inclusive (U.S. Department of Com- 
merce 1994, Attachment 18). 

Sampling weights can be adjusted to compensate for undercoverage. The CPS sampling 
weights are adjusted to independent population controls, in this case, projections based on 1990 
Decennial Census figures; information on births, deaths, and migration from various sources; 
counts of people in the Armed Forces and other institutions; and estimates of the Decennial Cen- 
sus undercount. In order to take into account differences among subgroups in the rate of under- 
coverage, the CPS weights are adjusted to the following population controls: the civilian 
noninstitutionalized population 16 years old and older, by state; the national civilian noninstitu- 
tionalized population of 14 Hispanic and 5 non-Hispanic age-sex categories; and the national ci- 
vilian noninstitutionalized populations of 66 white groups, 42 black groups, and 10 groups of 
other racial/ethnic backgrounds (U.S. Department of Labor 1997). 

However, if undercoverage is not random with respect to a particular characteristic, such as 
being home schooled, estimates related to that characteristic may be biased. Bias is the product of 
1) the difference between the rates of home schooling among omitted and included population 
members and 2) the rate of undercoverage in the population. Therefore, if the rate of home 
schooling among undercovered subpopulations were significantly different from that of covered 
subpopulations, the estimates relating to home schooling could be biased. For example, if boys 
who are omitted from the sampling frame were more likely to be home schooled than were boys 
who are included in the sampling frame, estimates of the number and proportion of home- 
schooled boys will be biased downwards. 

The data in tables 2 and 3 present two scenarios, one in which undercoverage leads to over- 
estimation of the number and proportion of children who are home schooled and another in 
which undercoverage leads to underestimation. For example, if no nonblack, 6- to 14-year-old 
girl who was omitted from the sample (highlighted row in table 2) were home schooled, the 
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Table 2 — CPS:Oct94 estimates of the number of 6- to 17-year-olds enrolled in school or home schooled in 
grades K-12, percentage home schooled, undercoverage rate, and percentage and number 
overestimated, assuming no home schooling among undercovered population, by age, 
race/ethnicity, and sex 





Total number 
of children 


Estimated 

percent 

home 

schooled 


Difference 
between 
estimated 
and minimum 
rate (0 percent) 


Undercoverage 

rate 

(percent) 


Overestimated 
Percent Number 


Total 43,163,000 

6- to 14-year-olds 


0.8 


0.8 


(*) 


0.05 


24,000 


Black 


Males 


2,583,000 


0.2 


0.2 


15.0 


0.03 


1,000 


Females 


2,537,000 


0.1 


0.1 


16.0 


0.02 


0 


Nonblack 


Males 


14,389,000 


0.9 


0.9 


8.0 


0.07 


10,000 


1 Females 


13,710,000 


1.1 


1.1 


4.0 


0.04 


6,000 | 


15 -year-olds 
Black 


Males 


269,000 


0.0 


0.0 


24.0 


0.00 


0 


Females 


278,000 


0.0 


0.0 


18.0 


0.00 


0 


Nonblack 


Males 


1,514,000 


0.7 


0.7 


7.0 


0.05 


1,000 


Females 1,425,000 

16- to 17-year-olds 


1.1 


1.1 


10.0 


0.11 


2,000 


Black 


Males 


510,000 


0.0 


0.0 


29.0 


0.00 


0 


Females 


535,000 


0.6 


0.6 


20.0 


0.12 


1,000 


Nonblack 


Males 


2,808,000 


0.6 


0.6 


12.0 


0.07 


2,000 


Females 


2,605,000 


0.4 


0.4 


11.0 


0.04 


1,000 



^Obtained from U.S. Department of Commerce 1994, Attachment 18. This source did not include an undercoverage rate for all 
children or all 6- to 17-year-olds. 



NOTE: Numbers are rounded to the nearest thousand. Note that although rates of home schooling were calculated for 6- to 17- 
year-old children, rates of undercoverage were not published for children in these age groups. The estimates of bias reported here 
depend on the assumption that 6- to 14-year-olds were undercovered at the same rate as children 0 to 14 years old and that 16- to 
17-year-olds were undercovered at the same rate as 16- to 19-year-olds. 

SOURCE: U.S. Department of Commerce, Bureau of the Census, Current Population Survey, October 1994 (CPS:Oct94). 
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Table 3— CPS:Oct94 estimates of the number of 6- to 17-year-olds enrolled in school or home schooled 
in grades K-12, percentage home schooled, undercoverage rate, and percentage and number 
underestimated, assuming rate of home schooling among undercovered population is three 
times the observed rate, by age, race/ethnicity, and sex 

Estimated 





Total number 
of children 


percent 

home 

schooled 


Three 
times the 
estimated rate 


Undercoverage 

rate 

(percent) 


Underestimated 
Percent Number 


Total 

6- to 14 -year- 


43,163,000 

olds 


0.8 


2.4 


(*) 


0.17 


72,000 


Black 


Males 


2,583,000 


0.2 


0.6 


15.0 


0.09 


2,000 


Females 


2,537,000 


0.1 


0.3 


16.0 


0.05 


1,000 


Nonblack 


Males 


14,389,000 


0.9 


2.7 


8.0 


0.22 


31,000 


Females 


13,710,000 


1.1 


3.3 


4.0 


0.13 


18,000 1 


15-year-olds 

Black 


Males 


269,000 


0.0 


0.0 


24.0 


0.00 


0 


Females 


278,000 


0.0 


0.0 


18.0 


0.00 


0 


Nonblack 


Males 


1,514,000 


0.7 


2.1 


7.0 


0.15 


2,000 


Females 
16- to 17-year 


1,425,000 

-olds 


1.1 


3.3 


10.0 


0.33 


5,000 


Black 


Males 


510,000 


0.0 


0.0 


29.0 


0.00 


0 


Females 


535,000 


0.6 


1.8 


20.0 


0.36 


2,000 


Nonblack 


Males 


2,808,000 


0.6 


1.8 


12.0 


0.22 


6,000 


Females 


2,605,000 


0.5 


1.5 


11.0 


0.17 


4,000 



*Obtained from U.S. Department of Commerce 1994, Attachment 18. This source did not include an undercoverage rate for all 
children or all 6- to 17-year-olds. 



NOTE: Numbers are rounded to the nearest thousand. Note that although rates of home schooling were calculated for 6- to 17- 
year-old children, rates of undercoverage were not published for children in these age groups. The estimates of bias reported here 
depend on the assumption that 6- to 14-year-olds were undercovered at the same rate as children 0 to 14 years old and that 16- to 
17-year-olds were undercovered at the same rate as 16- to 19-year-olds. 

SOURCE: U.S. Department of Commerce, Bureau of the Census, Current Population Survey, October 1994 (CPS:Oct94). 
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